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f MPEG 
\SPLICING 



-121 



INPUT DESIRED END 
FRAME OF FIRST CLIP AND 
DESIRED START FRAME 
OF SECOND CLIP 
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FIND CLOSEST I FRAME 
PRECEDING DESIRED START FRAME 
TO BE THE IN POINT 
FOR SPLICING 
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VIDEO 
SPLICING 
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AUDIO 
SPLICING 
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RE-FORMATTING INCLUDING 
RE-STAMPING OF PTS, DTS 
AND PCR'S FOR AUDIO 
AND VIDEO 



Cm) FIG. 19 
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SEAMLESS 
VIDEO SPLICING 
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ANCHOR THE FIRST DTS 

OF THE SECOND CLIP 
AT ONE FRAME INTERVAL 
LATER THAN THE LAST DTS 

OF THE FIRST CLIP TO 
PREVENT VIDEO DECODING 
DISCONTINUITY 



DOES 
THE PCR 



-142 



EXTRAPOLATED TO THE BEGINNING" 
FRAME OF THE SECOND CLIP FALL JUSL 
AFTER THE ENDING TIME 
OF THE FIRST 



NO 



CLIP? 



YES 
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ADJUST THE CONTENT OF THE 
FIRST CLIP SO THAT THE PCR 
EXTRAPOLATED TO THE BEGINNING 
FRAME OF THE SECOND CLIP FALLS 
JUST AFTER THE ENDING TIME OF 
THE FIRST CLIP 



END 



FIG. 22 
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Video 
Splicing 
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DETERMINE THE LAST DTS/PTS 
OF THE FIRST CLIP 
(DTS L1 ) 
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DETERMINE THE TIME OF 
ARRIVAL (T e ) OF THE LAST 
BYTE OF THE FIRST CLIP 
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ADD ONE FRAME INTERVAL 
TO DTS L1 TO FIND THE 
DESIRED FIRST DTS LOCATION 
FOR THE SECOND CLIP 
(DTS F 1=DTS L1 + 1 /FR) 
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KEEPING THE DTS-PCR e 
RELATION UNALTERED FOR 
THE SECOND CLIR FIND THE 
TIME INSTANT T s AT WHICH 

THE FIRST BYTE OF THE 
SECOND CLIP SHOULD ARRIVE 

(TSTART =DTS F2 -PCR e2 ) 
(T S =DTS F1 -T START ) 



FIG. 23 




INSERT NULL TS 

PACKETS TO 

COMPENSATE FOR THE 

GAP BETWEEN T e AND T s 

( T s -T e ) (BIT RATE) 
b r - g -i 
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OPEN UP A CERTAIN AMOUNT OF SPACE 
IN THE FIRST CLIP TO ACHIEVE 

T — T i 8 

■s-'e + BIT RATE 
THE NUMBER OF BYTES TO 
DROP IS 



1 + 



(T e -T s ) (BIT RATE) 
8 



IF POSSIBLE, REMOVE NULL PACKETS 
TO DROP THE BYTES, OTHERWISE, 
REPLACE ONE OR IF NEEDED MORE 
PREDICTED FRAMES WITH 
VARIABLE - SIZE FREEZE FRAMES 



-159 



CONCATENATE 
THE STREAMS 
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COMPUTE THE VIDEO 
TIME STAMP OFFSET 
Voffset 



K END 



FIG. 24 
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ISPLICINff 
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FIND THE AUDIO AU (IN THE FIRST CLIP) 
BEST ALIGNED WITH THE END FRAME 
OF THE FIRST CLIP (IN TERMS OF ENDING 
INSTANTS OF THEIR PRESENTATIONS) AFTER 
SPLICING THE VIDEO 



T 
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FIND THE AUDIO AU (IN THE SECOND CLIP) 
BEST ALIGNED WITH THE IN-POINT OF THE 
SECOND CLIP (IN TERMS OF THE STARTING 
INSTANT OF ITS PRESENTATION) 

I 

-173 

SECOND' 

CLIP'S MEAN 

AUDIO BUFFER 

LEVEL >B. 
? 
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IF THE ABOVE-DEFINED BEST ALIGNED 
AAUs DO NOT ACHIEVE A BACKWARD 
SKEW, THEN MODIFY THE BEST 
ALIGNED AAUs BY DROPPING ONLY 
ONE OF THEM IN EITHER OF THE 
CLIPS TO REDUCE THE MEAN BUFFER 
LEVEL FOR THE SECOND CLIP 



SECOND^ 
CLIP'S MEAN 
AUDIO BUFFER, 
LEVEL <i 
? 
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IF THE ABOVE-DEFINED BEST ALIGNED 
AAUs DO NOT ACHIEVE A FORWARD 
SKEW, THEN MODIFY THE BEST ALIGNED 
AAUs BY APPENDING ONE EXTRA AAU 
EITHER AFTER THE BEST ALIGNED AAU 
IN THE FIRST CLIP OR BEFORE THE BEST 
ALIGNED AAU IN THE SECOND CLIP TO 
INCREASE THE MEAN BUFFER LEVEL FOR 
THE SECOND CLIP 



FIG. 25 



REMOVE ALL AUs OF AUDIO IN THE FIRST 
CLIP AFTER THE BEST ALIGNED AAU IN THE 
FIRST CLIR AND ADJUST THE LAST AUDIO 
PES PACKET HEADER IN THE FIRST CLIP 
TO REFLECT THE CHANGE IN ITS SIZE IN BYTES 
AFTER THE REMOVAL 



FIND THE AUDIO PES PACKET IN THE SECOND 
CLIP WHICH INCLUDES THE BEST ALIGNED AAU 
IN THE SECOND CLIR AND REMOVE ALL AAUs 
PRECEDING THE BEST ALIGNED ONE IN THIS 
PES PACKET 



PRODUCE A PES PACKET HEADER TO ENCAPSULATE 
THE BEST ALIGNED AAU AND THE AAUs AFTER IT, 
AND WRITE THE PES PACKET SIZE INTO THE HEADER 



CALCULATE THE REQUIRED AUDIO PTS OFFSET 
TO BE USED FOR RESTAMPING THE AUDIO 
OF THE SECOND CLIP 



( end) 
FIG. 26 
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CASE 


SECOND CLIP HAS A 
HIGH MEAN AUDIO 
BUFFER LEVEL 


SECOND CLIP HAS A 

i r\\M i\/ir a m ai ir\in 

LOW MEAN AUDIO 
BUFFER LEVEL 


FIG. 11A 


USE FIG. 28 


USE FIG. 11B0R11C 


FIG. 12A 


USE FIG. 12B 


USE FIG. 29 


FIG. 13A 


USE FIG. 13B 


USE FIG. 30 


FIG. 14A 


USE FIG. 31 


USE FIG. 14B 


FIG. 15A 


USE FIG. 15B 


USE FIG. 32 


FIG. 16A 


USE FIG. 33 


USE FIG. 16B 


FIG. 17A 


USE FIG. 17B0R17C 


USE FIG. 34 


FIG. 18A 


USE FIG. 35 


USE FIG. 18B 



FIG. 27 
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(PTSj-PCRgj) (BIT RATE) 
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±H ^5)— * 



* ABV est 
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FIG. 36 
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FIG. 37 



29/40 



VOFFSET 
CALCULATION 



FIND THE DTS OF THE LAST 
FRAME (IN DECODE ORDER) 
OF THE FIRST CLIP 
(DTSvu) 



FIND THE ORIGINAL DTS OF 
THE FIRST FRAME TO BE 
DECODED IN THE SECOND CLIP 

(DTS VF2 ) 



-211 



-212 



-213 



COMPUTE 



VqffSET = DTS V |_1-DTS V F2 +(ONE VIDEO FRAME DURATION) 



END 



FIG. 38 
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^OFFSET 
vCALCULATIOI 



FIND THE PTS OF THE LAST AAU 
IN THE FIRST CLIP 

(PTS AL1 ) 



/-221 



FIND THE ORIGINAL PTS OF 
THE FIRST AAU TO BE 
DECODED IN THE SECOND CLIP 

(PTS A I2) 



T 



-222 



-223 



COMPUTE 



^OFFSET = PTS AL1 " PTS AI2 + ( 0NE AAU DURATION) 



END 



i 



FIG. 39 
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PCR OFFSET 
CALCULATION 



1 


r 


FIND THE EXTRAPOLATED PCR e 


FOR THE LAST BYTE 


OF THE FIRST CLIP 




(PCReLl) 





I 
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FIND THE ORIGINAL EXTRAPOLATED 
PCR e FOR THE FIRST BYTE OF THE 
SECOND CLIP 

(PCR eF 2) 



T 



-232 



-233 



COMPUTE 



PGR OFFSET = PCReL1"PCR e F2 + (piTRATE 



END 



FIG. 40 
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RESTAMPING 



ADD VqffSET to the dts and 
PTS FIELDS OF ALL VIDEO PES 

PACKETS IN THE SECOND CLIP 



T 



ADD AqffSET to the pts fields 
OF ALL AUDIO PES PACKETS IN 

THE SECOND CLIP 



COMPUTE THE PCR 
TIME STAMP OFFSET 

PCR OFFSET 
i 



ADD PCRqffSET TO ALL PCR 
RECORDS IN THE SECOND CLIP 



K 242 
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RESTAMP THE PID FIELDS 
OF THE TS PACKETS OF THE 
VARIOUS STREAMS IN THE 
SECOND CLIP BASED ON THEIR 
ASSOCIATIONS WITH THE VARIOUS 
STREAMS OF THE FIRST CLIP 
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RESTAMP THE CONTINUITY 
COUNTER FIELDS OF THE TS 
PACKETS OF THE VARIOUS 
STREAMS IN THE SECOND CLIP 



END 
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FIG. 41 
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LAST ROW REPETITION 
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LAST COLUMN 
REPETITION 



FIG. 42 



CUP #1 



j=NO. OF NON-OBSOLETE AUDIO PACKETS 
IN THE FIRST TS STREAM FOLLOWING THE 
END OF VIDEO AT THE OUT POINT 




k= TOTAL NO. OF NULL TS PACKETS 
AND OBSOLETE AUDIO PACKETS IN 
THE SECOND TS STREAM FOLLOWING THE 
BEGINNING OF VIDEO AT THE IN POINT 



FIG. 43 



RE-FORMATTING 
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DETERMINE: 

j= NO. OF NON-OBSOLETE AUDIO PACKETS IN THE FIRST 

TS STREAM FOLLOWING THE END OF VIDEO AT THE OUT POINT 



k= TOTAL NUMBER OF NULL PACKETS AND OBSOLETE AUDIO PACKETS 
IN THE SECOND TS STREAM FOLLOWING THE BEGINNING OF VIDEO 
AT THE IN POINT. 
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REPLACE ANY OF THE k NULL PACKETS OR OBSOLETE AUDIO PACKETS 
IN THE SECOND TS STREAM WITH CORRESPONDING ONES OF THE j 
NON-OBSOLETE AUDIO PACKETS IN THE FIRST TS STREAM, BEGINNING 
WITH THE MOST ADVANCED IN TIME PACKETS 

^274 




CHANGE ANY REMAINING OBSOLETE 
AUDIO PACKETS TO NULL TS PACKETS 
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FOR THE REMAINING (j-k) NON-OBSOLETE AUDIO PACKETS 
FROM THE FIRST STREAM, CREATE (j-k) * 188 BYTES OF 
ADDITIONAL SPACE FOR THEM IN THE SPLICED TS STREAM 
PRIOR TO THE VIDEO FOR THE OUT POINT. (THIS ADDITIONAL 
SPACE MUST BE GENERATED SO AS TO MAINTAIN THE 
T S =T e +8/(BIT RATE) CONDITION OF FIG. 24 FOR 
SEAMLESS VIDEO SPLICING.) 



END 



FIG. 44 
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MPEG FILE 



282 
283 



MPEG 
TS 



METADATA 
COMPUTATION 



284 



GOPO 
G0P1 
GOP 2 
GOP 3 
GOP 4 
GOP 5 



FIG. 45 



CLIP 
METADATA 



GOP INDEX 
TABLE 



MPEG 
TS 
DATA 



1 

MEGABYTE 



J 



285 



FRAME NO. 



POINTER TO 
MPEG TS DATA 



^284 

/ DTS, PCR e , 

AND OTHER GOP 



FLAGS 



ATTRIBUTES 



GOP n, 
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GOP INDEX DECIMATION 
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1 


^331 


GOP DECIMATION FACTOR 
IS INITIALLY SET TO ONE 
IN METADATA FOR THE CLIP 




^332 




DECIMATE GOP INDEX BY A 
FACTOR OF 2: 
FORi=0TO(NMAX/2-1), 

ENTRY ENTRY (2i+2) 

NEXT i 

FOR i = NMAX/2 TO NMAX, 
INVALIDATE ENTRY (i) 
NEXT i 



INCREASE THE DECIMATION 
FACTOR BY A FACTOR OF 2 



y-335 



FIG. 47 
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/Metadata calculations^ 
v for next gop j 




COMPUTE HIGH PRIORITY 
METADATA FOR THE GOP 



1 




COMPUTE LOW PRIORITY 
METADATA FOR THE GOP 



( END ) 

FIG. 48 
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CONTROLLER SERVER 

PLAY LIST 

.^320 



STREAM SERVER 
PLAY LIST , 



321 



FIG. 51 
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PROCESSING OF TEMPORARILY^ 
^CORRUPTED TRANSPORT STREAM/ 
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TS 

FROM SOURCE' 
CORRUPTED/NO 

? 

YES 
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CONTINUE REAL-TIME 
TRANSMISSION OF TS 
FROM SOURCE TO DESTINATION 



APPEND TO THE INTERRUPTED TS 
AND TRANSMIT TO THE DESTINATION 
A CONTINUING MPEG-2 
COMPLIANT TS OF FREEZE 
FRAMES, INCLUDING A PROPER 
FREQUENCY OF PCRS 
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SEAMLESSLY SPLICE TO THE TS 
OF FREEZE FRAMES THE TS NOW 
BEING RECEIVED FROM THE SOURCE, 
AND BEGIN REAL-TIME TRANSMISSION 
OF THE SPLICED TS TO THE 
DESTINATION 



FIG. 52 



